stochastic gradient descent
Related Words
optimizationalgorithmgradientlearningstochasticityconvergencecostlossfunctionparameterweightbiasderivativepartialbackpropagationneuralnetworkdeepepochiterationmomentumoptimizerconvexityconcavityminimummaximumoverfittingunderfittingregularizationdropoutnormalizationrandomnesssamplingdatasettrainingvalidationtestingerrorresidualhyperparameterdecayschedulermanifoldcurvatureHessianJacobianperceptronsigmoidtanhsoftmaxcomplexityefficiencycomputationvectorizationtensormatrixscalar